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Abstract 

We look at chaotic systems evolving in fractal phase space. The 
entropy change in time due to the fractal geometry is assimilated to 
the information growth through the scale refinement. Due to the in- 
completeness, at any scale, of the information calculation in fractal 
support, the incomplete normalization J2iPi = 1 is applied through- 
out the paper. It is shown that the information growth is nonadditive 
and is proportional to the trace-form J2i p$ — ^ pj so that it can be 
connected to several nonadditive entropies. This information growth 
can be extremized to give, for non-equilibrium systems, power law dis- 
tributions of evolving stationary state which may be called "maximum 
entropic evolution". 

PACS number : 02.50.Cw,02.70.Rr,89.70.+c,89.75.Da 



1 Introduction 

The aim of this paper is to study the information evolution of special sys- 
tems whose phase space volumes are or map into fractals or multifractals 
(e.g., dissipative chaotic systems whose phase space volume maps into frac- 
tal attractors for long time t — > oo). 

One of the motivations of this work is related to the generalizations [1] 
of Boltzmann and Gibbs entropies which are, in general, connected to dense 
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phase space (T-space). Some of these generalized entropies, e.g., Havrda- 
Charvat-Tsallis one[2, 3] or Renyi one [4], are believed to have some connec- 
tions with fractal geometry and chaotic behavior of non-equilibrium systems 
at stationary states. Our idea in this work is to look at the geometry of 
the fractal phase space, to calculate the information from simple geometri- 
cal consideration, and to see what is the property of the evolution of this 
information and if it has something to do with the generalized entropies. 

We suppose an ensemble moving in a fractal phase space, the volume of 
its initial condition gradually mapping into fractal structure. That is, as 
its trajectories run over all the permitted phase points, its phase volume is 
covered more and more such that a scale refinement would be necessary to 
calculate the occupied volume more and more exactly. Consequently, the 
long time behavior of the system of interest is likened to its ensemble be- 
havior : the information evolution in time is estimated by the information 
growth during the scale refinement. This is a crucial point of this work. Due 
to the incompleteness of the counting of state points or of the calculation of 
geometrical elements of fractal structure at any given scale[5], the discussion 
will be made on the basis of the so called incomplete normalization of prob- 
ability proposed for the study of the complex systems having physical states 
accessible to the systems but inaccessible to theoretical treatments [5, 6, 7, 8]. 

2 Fractal phase space normalization 

To take into account the incompleteness of countable information for a fractal 
phase space of dimension df embedded in a Euclidean space of dimension d, 
we have put [5] : 

v k 

E pi = h (i) 

where Vk is only the number of the accessible states at the k th iteration, q is 
given by q = df/d, and pi k = Sj fe /5o with Si k the volume of the i th element 
of the fractal at the k th iteration [5, 8] and S the volume of the phase space 
containing the fractal. 

The normalization in Eq.(l) for incomplete probability distribution was 
for the first time discussed by Tribus[9] some decades ago in the context of 
probability theory applied to decision theory in engineering and economics 
where pi was one of the solutions to the functional equation for logic induction 
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and might be considered as an effective probability. The probability defined 
in Eq.(l) is different from the usual frequency or time definition which is 
normalized. Here the probability p^s do not sum to one because it is the ratio 
of a non-differentiable fractal structure to an integrable and differentiable 
homogeneous space. This definition is analogous to that proposed in [10] to 
define probability pi by the ratio of the number of trajectories (volume s$) 
on the element s, to the total number of trajectories (total volume Sq) of the 
initial conditions. 

Eq.(l) has been called incomplete normalization. Its incompleteness 
means that the sum over all the Vf. elements at the k th iteration does not 
mean the sum over all the states of the system under consideration, because 
the volume Sk(i) does not represent the real number of states or trajectories 
on the element which, as expected for any fractal structure, evolves with k. 
So at any given order k, the summation over all possible elements is not equal 
to the complete summation over all possible states. 

3 Information growth due to fractal 

So there is expansion or contraction of state volume when we refine the phase 
space scale. This evolution of the accessible phase volume of a system during 
the scale refinement should be interpreted as follows : the extra state points 

A h = E s h+i ~ s i k ( 2 ) 
i*,+i=i 

acquired from certain element ik at the iterate of (k + l) th order are just the 
number of unaccessible states at k th order with respect to (k + \) th order, 
where rii k is the number of elements Sj k+l replacing, at (k + l) th iterate, 
the element Sj fe . Aj fc > (or < 0) means that we have counted less (or 
more) states at k th order than the states really accessible to the system. A ik 
contains the accessible information gain (AIG) through the (k + l) th iterate. 

To illustrate the relation between this "hidden information" and the pa- 
rameter q, let us suppose that the probability density p is scale-invariant with 
Js p q ds = 1 according to incomplete normalization. At the iterate of order 
k, the information content on Sk(i) is given by 

J fc (z) = / I(p)ds (3) 

Js ik 
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where J(p) is the information density. At k + 1 order, we have 



WO = L % (4) 

Now we suppose constant p over each element i k , i.e., p ife oc s ik . This is true 
for very small elements after a long evolution of the system of interest or for 
the case where every phase point is visited with equal probability. Then AIG 
reads 

AJ fc (i) = I k+1 (i) - I fc (i) = / I{ P )ds = I(p)A ik (5) 
The relative AIG is given by 

R k ^ {k+1) (i k ) = AI k (i)/I k (i) (6) 
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ife+l=l Pifc 

Eq. (6) suggests that the average value or the expectation of the relative AIG 
over all the fractal may be calculated with two possible methods. 

1. By unnormalized expectation : 

Rk^(k+i) = ^2 Pi k Rk^{k+i)(ik) (7) 

ifc=l 

v k+l Vk 
= Pik+l ~ Pik 



l fc+l : 



=1 i fc =l 



where v k (or ffc+i) is the total number of elements of the fractal at k th 
(or {k + 1) ) iteration. 

2. Or by normalized expectation with escort probability : 



R 



fc->(fc+i) 



Ei fc fe =i Pi k R k ^(k+i) {ik) 



Y^i *=1 



(8) 



Effe 
»fe= 



1. 
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The total AIG from th up to k th iteration is then given by 



R k = R ^ k = R ^ k = J2 Vx k ~ 1 = J2 (Ph - P? fc ) 



(9) 



ife=l *fc=l 



because E^iPio = So/So = 1- 

So from just geometrical consideration, we end with an information change 
which is proportional to the trace-form J2l k =i(Pi k ~Pi k )- We see that if q = 1 
or d = dj, the fractal structure does not exist any more, and Rk = 0. So this 
is indeed an information evolution due to the fractal geometry of the phase 
space. 

If one want to write pi = pf, then Rk reads Rk = J2it=i Pii 9 ~ 1 with 
J2iu=i Pi k — 1- can be seen as a complete probability distribution. In this 
case, do not forget that pi k is not the real probability pi k . 

If we divide certain functional of Rk by the dimension difference df — d, 
we can get several of the trace form entropies in the long list [1] posited, from 
mathematical considerations, as possible alternatives to Gibbs or Shannon 
entropy S = — J2iPi^- n Pi- F° r example, gives the Havrda-Charvat- 

Tsallis entropy S q = ^**Ip p? [2, 3], ln( c f^ 1) gives Renyi entropy S R = 

In a In 

° l^cf' ( a = V<?) f° r complete distribution [1] or S R = for incomplete 

distribution [11], and {Rk+ ^^ d ~ l gives Arimoto entropy S A = ^ )<? " 1 [12], 
among others. It is worth noticing that all these entropies recover Gibbs- 
Shannon entropy S when q — > 1 or df — > d 

4 Some properties of i?^ 

1. Nonadditivity : for a fractal of dimension df composed of two sub- 
fractals 1 and 2 of dimension df l and df 2 satisfying product joint prob- 
ability Pi ki i k2 = Pi kl Pi k2 , it is easy to show the following nonadditivity 



2. Concavity and convexity : Rk is positive and concave for q > 1 and 
negative and convex for q < 1, as shown in Figure 1. 



R klk2 (l + 2) = i2 fcl (l) + R k2 {2) + R kl (l)R k2 {2). 



(10) 
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3. For a self-similar fractal whose is the same for all elements and for 
any iteration order, the AIG per iteration given by Eq.(6) is indepen- 
dent of ik : 

n n 

R= £ ^1-1= E rj-l, (11) 

where r*j is the scale factors of the j th element of the n ones for an 
iteration. If all r/s are equal : rj = l/m d , we get 

R = n /m d - 1 = (1 - q)\n q (l/m d ) (12) 

where ln g is called generalized logarithm and given by ln g x = xl 1 ^_~ 1 ■ 

For a Cantor set, n = 2, m = 3, d = 1 et q = df = 0.63, R = —1/3. 

For a two scale Cantor set with, say, r\ = 1/5 and T2 = 3/5, q or df is 
determined by (1/5) 9 + (3/5) 9 = 1, i? = -1/5. 

For von Koch curve, n = 4, m = 3, d = 1, q = df = 1.26, and R— 1/3. 

For Serpinski gasket, n = 3, m = 2, and d = 2, so df = = 1.58, 
g = df/d = 0.79 and i? = -0.25. 

For Menger's sponge, n = 20, m = 3, and d = 3, so d/ = 2.73, 
q = df/d = 0.9 and R = -0.26. 



5 Some possible applications 

Now we address stationary probability distribution of non-equilibrium non- 
additive systems. The actual idea of the nonextensive statistical mechanics 
(NSM) based on Havrda-Charvat-Tsallis entropy[3] is to maximize entropy, 
just for equilibrium state, to get the stationary power law distributions. This 
philosophy seems plausible for the systems that have much smaller relaxation 
time to reach stationary state than the necessary time interval for the inter- 
action to change the state. But the method is not justified for stationary 
state in general or for non-equilibrium systems which are in evolution with 
their entropy changing constantly. 

In view of the concavity (q > 1, Rk > 0) or convexity (q < 1, Rk < 0) of 
Rk (see Figure 1) and of its connections with different entropies or informa- 
tion measures, it can be easily checked that the maximum entropy principle 
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Figure 1: The concavity and convexity of the relative information growth Rk 
for q > with a two probability distribution p\ — x and P2 = (1 — x q ) l l q 
satisfying J2i=iPi = 1- Rk is concave for q > 1 and convex for q < 1. 

is mathematically equivalent to the extremization of the information growth 
Rk- Our idea here is to extremize Rk in order to obtain the probability dis- 
tributions of the stationary states. In this case, the stationary state is a kind 
of "dynamical equilibrium" or, more precisely, "equilibrium (stable) evolu- 
tion" that, extremizes the information (entropy) growth Rk and maximizes 
the entropies at any moment with respect to other possible evolutions. For 
this reason, the probability distributions obtained from extremizing Rk can 
be called probability distribution for maximum entropic evolution. Following 
are some examples of power law distributions obtained by the i^-extremum. 

1. The continued fraction map[13] is given by x n+ i = l/x n — \ l/x n ~\ 
where [1 / x n ~\ is the integer part of 1 jx n and real number between 

and 1. The probability distribution is given by p(x) = 1/(1 + x) In 2 
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and satisfies Jq 1 p(x)dx = 1. This distribution can be obtained by ex- 
tremizing 

R k = f 1 p( x )dx - 1 (13) 



under the constraints associated with the normalization Jq 1 p q {x)dx = 1 
and with the unnormahzed expectation x = f\o <x< q p{x)xdx or with 

~ Jla p(x)xdx 

the normalized expectation x = I <x< — , , , , we can obtain the dis- 

/.„ , p(x)dx 

tribution 

P(X) = ~ pq{x) = (l-p C X )*/V-*) (14) 

where q — 1/2, (3 = — lis the Lagrange multiplier associated with x 
and the constant c = 1/ In 2 is determined by the normalization. 

2. The Ulam maps is a logistic map x n+ \ = 1 — px 2 n (— 1 < x < 1) with 
H = 2. Its probability distribution is given by p{x) = 7r ( 1 _^2)i/2 which 
is normalized [13]. By extremizing Rj, under the constraints associated 
with $\p(x) q dx = 1 and with the unnormahzed expectation x 2 = 

i „ ~ f 1 p(x)x 2 dx 

J_i p(x)x dx or with the normalized expectation x 2 = ~\ , we 

J _i p(x)dx 

can obtain a distribution 

p{x) = p«{x) = (1 _ ^ 2)q/(1 _ q) (15) 

where q = 1/3, /3 = 1 is the Lagrange multiplier associated with x 2 and 
the constant c = 1/ir is determined by the normalization. 

3. The Zipf-Mandelbrot's law p{x) = nz^yr is an useful chaotic dis- 
tribution for some complex systemsfl l], where A, B and 7 are con- 
stants. Using the same machinery as above, one obtain : 

p{x) = (i-/4*/m (i6) 

where /3 — B is the Lagrange multiplier associated with x, 1/g = I + I/7 
and A should be determined by the condition f_ x p(x)dx = 1. 
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6 Conclusion 



In summering, we have discussed the accessible information growth (AIG) 
during long time evolution of some chaotic systems or through the scale 
refinement in their fractal phase space. AIG turns out to take the trace 
form J2i Pi — J2i Pi so that it can be connected with several entropies which 
generalize the Gibbs-Shannon one. It is argued that, for non-equilibrium 
systems, it would be more natural to extremize AIG, instead of maximizing 
entropy, to get the stationary probability distributions. It turns out that 
this extremization is mathematically equivalent to the maximization of the 
relevant generalized entropies. Several power law distributions have been 
obtained from the extremization of AIG. 

On the other hand, the AIG of this work has been calculated for chaotic 
systems whose phase space is or maps into fractals. So it may be invalid for 
other non-equilibrium systems that do not have this property. What is the 
information growth in that case? How to obtain the probability distribution 
for these non-equilibrium systems? Does the method of extremum informa- 
tion growth applies in general to them? What is the thermodynamics of the 
"dynamical equilibrium" of this nonadditive systems in constant evolution? 
All these questions, together with other fundamental questions about NSM, 
still remain open. 
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